A CONTINUOUS VARIANT OF THE INVERSE 
LITTLEWOOD-OFFORD PROBLEM FOR QUADRATIC FORMS 
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Abstract. Motivated by the inverse Littlewood-Offord problem for linear forms, we study 
the concentration of quadratic forms. We show that if this form concentrates on a small 
ball with high probability, then the coefficients can be approximated by a sum of additive 
and algebraic structures. 



1. Introduction 

1.1. The Littlewood-Offord problem for linear forms. Let £ be a real random vari- 
able, and let A = {a\, . . . , a n } be a multiset in R d . For any j3 > 0, we define the small ball 



probability as 



Pp,${A) := sup P x (aiXiH h a n x n GB(a,/3)), 

aeR d 

where x = (xi, . . . ,x n ) and X{ are iid copies of £, and B(x,j3) denotes the closed disk of 
radius /3 centered at x in R rf . 

A classical result of Erdos [3] and Littlewood-Offord [7] asserts that if £ has Bernoulli 
distribution and are real numbers of magnitude |o*| > /3, then 

PPA (A) = 0(n-V 2 ). 

This remarkable inequality has generated an impressive way of research, particularly from 
the early 1960s to the late 1980s. We refer the reader to [HG3E] and the references therein. 

Motivated by inverse theorems from additive combinatorics (see \17\ Chapter 5]), Tao and 
Vu brought a new view to the problem: find the underlying reason as to why the small ball 
probability is large (say, polynomial in n). 

Typical examples of A, where pp^ is large, involve generalized arithmetic progressions 
(GAPs), an important concept from additive combinatorics. 

A set Q C R d is a GAP of rank r if it can be expressed as in the form 

Q = {do + fclfll + • • • + k r g r \Ki < ki < K[ for all 1 < i < r} 
for some go, . . . ,g r G R rf , and some integers K±,..., K r ,K[, . . . , K' r . 



2 



HOI H. NGUYEN 



It is convenient to think of Q as the image of an integer box B := {(xi, . . . , x r ) E Z r |fQ < 
ki < K-} under the linear map 

$ : (xi, . . . , x r ) (->■ g + xigi H h x r g r . 

The vectors ^ are the generators of Q, the numbers K[ and .fQ are the dimensions of Q, 
and Vol(Q) := \B\ is the volume of Q. We say that Q is proper if this map is one to one, 
or equivalently if \Q\ = Vol(Q). For non-proper GAPs, we of course have \Q\ < Vol(Q). If 
go = and —Ki = K'- for all i > 1, we say that Q is symmetric. 

Example 1.2. Lei Q = {X^I=i ^iffil ~ Ki < ki < Ki} be a proper symmetric GAP of rank 
r = 0(1) and size N = n°W. A ssume that £ has Bernoulli distribution, and for each ai 
there exists qi £ Q such that ||aj — q\\2 < d~- 

Then, because the random sum Y^i Qi x i takes value in the GAP nQ := {X]i=i \ ~ n Ki < 
ki < nKi}, a nd because \nQ\ < n r N = , the pigeon-hole principle implies that YiqiXi 
takes some value in nQ with probability n^°^\ Thus we have 

PnS4 (A) = n-°W. (1) 

The above example shows that if £ has Bernoulli distribution and if aj are close to a GAP 
of rank O(l) and size n oi - l \ then A has large small ball probability. 

It was shown (rather implicitly) by Tao and Vu in |12|, [T3| [T5| [T6] that these are essentially 
the only examples which have large small ball probability. An explicit version was given by 
Vu and the current author under the following condition. 

Condition 1 (Anti-concentration). There exist positive constants < c\ < C2 and a such 
that 

P(ci < <c 2 ) > ca, 

where £' is an independent copy o/£. 

We note that Bernoulli random variables rj^ (which equal ±1 with probability u/2 and 
with probability 1 — fj,), where the parameters u are bounded away from 0, are clearly of 
this type. 

We say that a vector a is 5-close to a set Q if there exists q G Q such that \\a — q\\2 < S. 

Theorem 1.3 (Inverse Littlewood-Offord theorem for linear forms, |10|). Let < e < 1 

and B > 0. Let j3 > be a parameter that may depend on n. Suppose that £^ = 1 

and 

P ■= P/3,d A ) ^ n ~ B i 

where X{ are iid copies of a random variable £ satisfying Condition^ Then, for any number 
n' between n e and n, there exists a proper symmetric GAP Q = {X)i=i ki9i '■ < Ki} 
such that 
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At least n — n' elements of Oj are f3-close to Q. 
Q has small rank, r = Oe,e(l), and small size 

-i 



\Q\ <max(0 B , f (7=),l). 



P 

n' 

• There is a non-zero integer p = Os,e(V n ~') such that all steps gi of Q have the form 
9i = (9ii, ■ ■ -,9id), where g {j = /3^L with p 4j - G Z and \pij\ = Ob^" 1 vV). 

In this and all subsequent theorems, the hidden constants could also depend on d and 
ci, C2, C3 of Condition[TJ We could have written Od, Cl ,c 2 ,c 3 {-) everywhere, but these notations 
are somewhat cumbersome, and this dependence is not our focus, so we omit them. Theorem 
11.31 was proven in |10| with c\ = 1,C2 = 2 and C3 = 1/2, but the proof there extends to the 
general case rather automatically. 

Notation. Let x\, . . . ,x n be real numbers, and let a\, . . . , a n be vectors in R^. To simplify 
our presentation, we will denote the sum vector Y2i a i x i by a ' x ! or x • a, where x = 
(xi, . . . , x n ) and a = (a\, . . . , a n ). For instance, the small ball probability can be expressed 
as 



U (A) = sup P x (x • a G B(a, /?)) . 



1.4. The Littlewood-OfFord problem for quadratic forms. Let £ be a real random 
variable, and let A = (aij) be an n x n symmetric matrix whose entries are vectors of H d . 
For any f3 > 0, we define the quadratic small ball probability as 



p$£{A):= sup P( ^ ajjXjXj + ^ bjXj G B(a, 0)) . 

a,bi,...,6 n gR d jj- j 

where iid copies of £. 

It follows from Theorem 3.1] and [2., Corollary 4.4] that if £ has Bernoulli distribution 
and if there are 0(n) indices i for each of which there are 0(n) indices j such that ||ojj H2 > /3, 
then the following holds for some explicit constant c > 



= 0(n" c ). (2) 

By using a recent result of Costello [T], one can improve the right hand side to 0{n~ l l 2+0 ^), 
which is asymptotically tight. 

It seems that one can improve the bound further by imposing new assumptions on a™. 
However, this is not our goal here. Motivated by the inverse Littewood-Offord problem for 
linear forms, we would like to find the underlying reason as to why the quadratic small ball 
probability is large (say, polynomial in n). 
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In the following examples, £ has Bernoulli distribution, and for each aij there exists q^ such 
that 

11%' - Qijh ^ 

Example 1.5. Let Q be a proper symmetric GAP of rank r = 0(1) and size n°^ l \ Assume 
that the approximated values qij belong to Q. 

Then, because the random sum Yli j 1ij x i x j takes value in the GAP n 2 Q, and because the 
size of n 2 Q is , the pigeon-hole principle implies that Ylij Qij x i x j takes some value in 
n 2 Q with probability n^ ^\ Passing back to aij, we obtain 

p nH ^A)=n-°W. 

One observes that this example is similar to Example 11.21 in which case have additive 
structure. However, unlike what we in the linear case, there are examples of different nature 
where the quadratic small ball probability can be large. 

Example 1.6. Assume that can be written as q^ = kibj + kjbi, where bi are arbitrary 
in H d and ki are integers bounded by such that 

PxE^x 4 = 0)=n-°( 1 ). 

i 

Then, we have 

P(J^ Qij x i x j = 0) = P(J^ k lXi ^ b jXj = 0) = n-°^\ 
i,j i 3 

Passing back to a^-, we obtain 

p nH £{A)=n-°W. 

Motivated by 11.51 and II. 6| we now consider a more complicated example. 

Example 1.7. Assume that q, L j = q'- + q'(-, where q'^ G Q, a proper symmetric GAP of 
rank 0(1) and size , and q'/j = kubij + kjibu + • • • + ki r b r j + kj r b r i , where r = 0(1), 
and bu, . . . ,b r i are arbitrary in Ti d , and kn, . . . , ki r are integers bounded by such that 

P x ( ^ ^ ki\Xi = 0, . . . , ^ ^ ki r X{ = 0) = n ^ . 

i i 

Observe that 
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b\jXj) + • • • + ( y ] ki r X{)(^2 WjXj). 

i,3 i,j i j i j 

Thus, 

sup P x (> , qijXjXj = q) = n~° (1) . 

q£n 2 Q y 

Passing to aij, we obtain 

p nH ^A)=n-°W. 

In this example, the matrix (q^) is a sum of two unrelated submatrices (q'^) and (q'/j)- one 
has entries belonging to a GAP of rank 0(1) and size n°^\ and one has rank O(l). 

Our main theorem partially demonstrates that if pp^(A) is large, then are close to some 
qij taking the form of Example 11.71 

We denote by Ti(A) the row (an, . . . , Oj n ) of A. 

Theorem 1.8 (Inverse Littlewood-Offord theorem for quadratic forms). Let < e < 1 and 

B > 0. Let (3 > be a parameter that may depend on n. Assume that = aj%, and 



Then, there exist an integer k ^ 0, \k\ = n° B ' e ^' , a set of r = 0(1) rows r^,... , r j r of A, 
and set I of size at least n — 2n e such that for each i £ L, there exist integers ka x , . . . , ka r , 
all bounded by n® 3 *^, such that the following holds. 

P z (||z.(M^) + E^ r ^))ll2 <fin° B »V>) >n-° fl .'«, (3) 
j 

where z = (zi, . . . , z n ) and z% are iid copies of r/ 1 / 2 )^ — £,'), where rj^ 1 ' 2 ' is a Bernoulli 
random variable of parameter 1/2 which is independent of £ and 

It follows from ([3]) and from Theorem 11.31 that for each i £ L, most of the entries of 
kri(A) + kiijTi^A) are ^n° B ' e ^ -close to a symmetric GAP of rank 0(1) and size n ^. 
In other words, Theorem 11.81 asserts that, modulo some special linear combinations of 
rj 1 (^4), . . . ,Ti r (A) (where the coefficients are integers bounded by n°^), most of the com- 
ponents of Ti(A) are /3n°W -close to a symmetric GAP of rank 0(1) and size . 
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Theorem 11.81 seems to be useful. It plays a crucial role in our work [9] of establishing 
polynomial bounds for the singular value of random symmetric matrices. We remark that 
a discrete version of Theorem 11.81 was discussed in an earlier paper [8] . 

2. A RANK REDUCTION ARGUMENT AND THE FULL RANK ASSUMPTION 

This section, which is independent of its own, provides a technical lemma we will need for 
later sections. Informally, it says that if we can find a proper symmetric GAP that contains 
a given set, then we can assume this containment is non-degenerate. 

Assume that P = {k\gi + • • • + k r g r \ — Ki < ki < Ki} is a proper symmetric GAP, which 
contains a set U = {m, . . . -u n }. 

We consider P together with the map $ : P — > R r which maps k\g\ + • • • + k r g r to 
k r ). Because P is proper, this map is bijective. 

We know that P contains U, but we do not know yet that U is non-degenerate in P in the 
sense that the set &(U) has full rank in R r . In the later case, we say U spans P. 

Theorem 2.1. Assume that U is a subset of a proper symmetric GAP P of size r, then 
there exists a proper symmetric GAP Q that contains U such that the followings hold. 

• rank(Q) < r and \Q\ < O r (l)\P\. 

• U spans Q, that is, 4>{U) has full rank in R, rank (Q). 

To prove Theorem 12.11 we will rely on the following lemma. 

Lemma 2.2 (Progressions lie inside proper progressions, [IZ])- There is an absolute con- 
stant C depending in d such that the following holds. Let P be a GAP of rank r in YL d . 
Then there is a symmetric proper GAP Q of rank at most r containng P and 

\Q\<r Cr3 \P\. 

Proof, (of Theorem 12. 1[) We shall mainly follow [14|, Section 8] . 

Suppose that <&(U) does not have full rank, then it is contained in a hyperplane of R r . In 

other words, there exist integers a±, . . . , a r whose common divisor is one and a\k% H + 

a r k r = for all (fci, . . . , k r ) G ®{U). 

Without loss of generality, we assume that a r ^ 0. We select w so that g r = a r w, and 
consider P' be the GAP generated by g\ := gi — ctiW for 1 < i < r — 1. The new symmetric 
GAP P' will continue to contain U, because we have 

hg[ H h &r-i5r-i = hgi H h k r g r - w(aik l H h a r g r ) 

= hgi H h k r g r 



INVERSE LITTLEWOOD-OFFORD PROBLEM FOR QUADRATIC FORMS 7 

for all (fci,...,fc r ) € $(17). 

Also, note that the volume of P' is 2 r ~ l K\ . . . K r —\, which is less than the volume of P. 

We next use Lemma 12.21 to guarantee that P' is symmetric and proper without increasing 
the rank. 

Iterate the process if needed. Because the rank of the newly obtained proper symmetric 
GAP decreases strictly after each step, the process must terminate after at most r steps. 

□ 

3. A DECOUPLING LEMMA AND INVERSE PROBLEM FOR BILINEAR FORMS 

As the first step to establish Theorem 11.81 we P ass to bilinear forms by using a decoupling 
technique. 

Let U be a subset of {1, . . . , n}. Let Ay be a symmetric matrix of size n by n defined as 



Ay(ij) 



aij if either i € U and j ^ U, or i ^ U and j £ U, 
otherwise, 



where we denoted by Ay(ij) the ij entry of Ay. 
Lemma 3.1 (Decoupling lemma). Assume that 



p= sup P x ( [| /, ajjXjXj + } y bjXj — a|| 2 < ft ) > n 

a,6i,...,6„ 



—B 



hi 



Then, 



P V)W (|| Ay(ij)v iWj \\ 2 = B (f3y^l)) = 6(p 8 ), (4) 



'■•J 



where v = {v\, . . . ,v n ), w = (wi, . . . ,w n ), and Vi,Wj are iid copies of £ — 
We refer the reader to Appendix [A] for a proof of this lemma. 

Lemma 13 . 1 1 asserts that if pp^{A) is large then ^ i ■ Ay(ij)viWj has small norm with high 
probability. This fact allows us to deduce useful information for Ay (for all U) by combining 
with the following inverse- type result. 

Theorem 3.2 (Inverse Littlewood-Offord theorem for bilinear forms). Let < e < 1 and 

B > 0. Let j3 > be a parameter that may depend on n. Assume that 
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supP Xiy (|| y~] aijXiyj - a\\ 2 < /?) > n B , 

a . .. 

i,j<n 

where x = (x\, . . . , x n ), y = (jji, . . . , y n ), and Xi and yi are iid copies of a random variable £ 
satisfying Condition^ Then, there exist an integer k 7^ 0, \k\ = n° B ^ l \ a set of r = O(l) 
rows rjj , . . . , rj r of A, and set I of size at least n — 2n e such that for each i £ I, there exist 
integers ka iy . . . , ka r , all bounded by n OB ^^\ such that the following holds. 

P y (||y(fcr i (^) + ^fe,r i ,(^))|| 2 <^n°^W) > rr°^« (5) 
j 

For the rest of this section, we prove Theorem 13.21 

First of all, for minor technical reasons, it is convenient to assume £ to have discrete distri- 
bution. The continuous case can be recovered by approximating the continuous distribution 
by a discrete one while holding n fixed. 

For short, we denote the vector (an, ■ ■ ■ , Oj n ) by a^. We begin by applying Theorem 11.31 
Lemma 3.3. Let e < 1, and B be positive constants. Assume that 

p = sup P x , y (1 y \ aijXjyj - a\ < 0) > n~ B . 

a . . 

M 

Then, the following holds with probability at least 2>p/A with respect to y = (yi,...,y n ). 
There exist a proper symmetric GAP Q y C H d of rank O b and size max(OB ]e (p _1 /w^ 2 ), 1), 
and an index set I y of size n — n e such that aj • y is (3-close to Q y for all i £ I y . 

Proof, (of Lemma I3.3|) Write 

n 

^dijXiyj = ^x^ ■ y). 
i,j i=l 

We say that a vector y = (y±, . . . , y n ) is good if 

n 

P x (|^x l (a,-y)-a| < p) > p/4. 

i=i 

We call y bad otherwise. 

Let G denote the collection of good vectors. We are going to estimate the probability p of 
a randomly chosen vector y = (yi, ■ ■ ■ , y n ) being bad by an averaging method. 
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P y P x (|^x i (a J -y)-a| < $) = p 

pp/4 + 1 - p > p 
(1 - p)/(l - p/A) > p. 

Thus, the probability of a randomly chosen y belonging to G is at least 

l-p>(3p/4)/(l-p/4)>3p/4. 
Consider a good vector y G G. By definition, we have 

n 

P x (|^x 4 (a 4 -y)-a| < 0) > p/A. 

i=i 

Next, if aj • y = for all i, then the conclusion of the lemma holds trivially for Q y := 0. 
Otherwise, we apply Theorem 11.31 to the sequence {a^ ■ y, i = 1, . . . ,nf (after a rescaling). 
As a consequence, we obtain an index set I y of size n — n e and a proper symmetric GAP 
Q y of rank Ob j(; (1) and size max^B^ip 1 /n- e ^ 2 ), 1), together with its elements %(y), such 
that ||aj • y - <fe(y)||2 < P for all i £ I y . □ 

We now work with qi(y), where y G G. 

Common generating indices. By Theorem 12. 1[ we may assume that the qi(y) span Q y . 
We choose from I y s indices i yi , . . . , i Vs such that qi y . (y) span Q y , where s is the rank of 
Q y . Note that s = Os, e (l) for all y G G. 

Consider the tuples (i yi , . . . ,i Vs ) for all y G G. Because there are Os, e (n s ) = n° B ' e ^ 
possibilities these tuples can take, there exists a tuple, say (1, ... ,r) (by rearranging the 
rows of A if needed) , such that (iy 1 , . . . , iy g ) = (1, . . . , r) for all y G G', a subset G' of G 
which satisfies 

P y (y G G') > P y (y G G)/n° c -^ = p/n° B ^ . (6) 

Common coefficient tuple. For each 1 < i < r, we express q%(y) in terms of the 
generators of Q y for each y G G', 

Qi(y) = Cii(y)gi(y) H h c ir {y)g r (y), 

where Cji(y), . . . Cj r (y) are integers bounded by n° B '^ 1 \ and gi(y) are the generators of Q y . 
We will show that there are many y that correspond to the same coefficients cy. 
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Consider the collection of the coefficient-tuples ^(cn(y), . . . , ci r (y)) ; . . . ; (c r i(y), . . . c rr (y))^ 
for all y G G'. Because the number of possibilities these tuples can take is at most 

( n OB,e(l)y 2 = „0 B , e (l)_ 

There exists a coefficient-tuple, say ^(cn, . . . , ci r ), . . . , (c r i, . . . c rr )^ , such that 

((cn(y), • • • ,ci r (y)); . . . ; (c r i(y),. . . c rr (y))) = ((c n ,. . . ,c lr ), (c rl ,. ..c rr fj 
for all y G G", a subset of G' which satisfies 

P y (y G G") > P y (y G G')/n° s . e(1) > p/n *^ 1 ). (7) 

In summary, there exist r tuples (en, . . . , ci r ), • • • , (c r i, . . . c rr ), whose components are in- 
tegers bounded by n° B ^ l \ such that the followings hold for all y G G" . 

• Qi(y) = Cji3i(y) H 1- Cj>5r(y), for i = 1, . . . ,r. 

• The vectors (en, . . . , c\ r ), . . . , (c r i, . . . c rr ) span Z rank (^y). 

Next, because |/ y | > n — rf for each y G G", by an averaging argument, there exists a set 
/ of size n — 2n e such that for each i € / we have 



P y (iG/ y ,yGG' / )>P y (yGG")/2. (8) 

From now on we fix an arbitrary row a of index from I. We will focus on those y G G" 
where the index of a belongs to I y . 

Common coefficient tuple for each individual. Because q(y) G Q y (q(y) is the element 
of Q y that is /3-close to a • y), we can write 



q(y) = ci(y)5i(y) + • • • c r (y)g r (y) 

where Q(y) are integers bounded by n° B >^ l \ 

For short, for each i we denote by Vj the vector (en, . . . ,Q r ), we will also denote by v ajy 
the vector (ci(y), . . . c r (y)). 

Because Q y is spanned by qi(y), ■ ■ ■ , q r (y), we have k = det(vi, . . . v r ) / 0, and that 



My) + det(va, y , v 2 , . . . , v r )gi(y) + • • • + det(v a ,y, vi, . . . , v r _i)g r (y) = 0. (9) 
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It is crucial to note that k is independent of the choice of a and y. 

Next, because each coefficient of Q is bounded by n° B ^ l \ there exists a subset G'^ of G" 
such that all y G G" & correspond to the same identity, and 

P y (y G G"g) > (P y (y G G")/2)/(n° s ^ 1 )) r = p/n° B ^ = n -° B ^ . (10) 

In other words, there exist integers k\,...,k r depending on a, all bounded by n° B ' t ^ 1 \ such 
that 

kq(y) + k iqi (y) + ■ ■ ■ + k r q r (y) =0 (11) 

for all y G G^. 

Passing back to ^4. Because %(y) are /3-close to aj • y, it follows from (jlip that 

||fca • y + fciai • y + • • • + k r a r ■ y|| 2 = ||(fca + fciai + • • • + a r ) • y|| 2 < n° B ^ l) p. (12) 
Furthermore, as P y (y G Gv[) = n~° B < <i ^ 1 \ we have 

P y (||(A;a + A;iai + ---+A; r a r )-y||2 < n° B ^f3) = n~° B ^. (13) 

Because (|13|) holds for any row a indexing from /, we have obtained the conclusion of 
Theorem 13.21 

4. proof of Theorem 11.81 

By the definition of £, it is clear that the random variable £ — £' also satisfies Condition 
[T] (with different positive parameters). We next apply Theorem 13.21 to (dJ to obtain the 
following lemma. 

Lemma 4.1. There exist a set Iq{U) of size Ob e(l) a set I(U) of size at least n — n e , 
and a nonzero integer k(U) bounded by n° B < c ^ such that for any i G I, there are integers 
ku (U),io G Iq(U), all bounded by n° B '^ l > , such that 

P y (\\(k(U) ai (Au) + £ kn (U)a io (A u )) ■ y\\ 2 < /3n°^«) = n~° B ^\ 



where y = (y\, . . . , y n ) and yi are iid copies of £ — 
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Note that this lemma holds for all U C [n]. In what follows we will gather these information. 

As Io(U) C [n] 0s ' e( ' 1 - > and k(U) < n, there are only n 05 -'' 1 ' possibilities that the tuple 
(Io(U), k(U)) can take. Thus, there exists a tuple (Iq, k) such that Iq(U) = Iq and k(U) = k 
for 2 n /n° B ^ different sets U. Let us denote this set of U by U; we have 

\U\ > 2 n /n° B ^ 1 \ 

Next, let I be the collection of all i which belong to at least \U\/2 index sets Ijj. Then, 



\I\\U\ + {n-\I\)\U\/2> (n-n e )\U\ 
\I\ > n-2n e . 

From now on we fix an i G I. Consider the tuples (ku (U) , io G Io) over all U where 
i G Ijj- Because there are only n° B ^ possibilities such tuples can take, there must 
be a tuple, say (ku ,io G Io), such that (ku Q (U),io G Io) = (ku ,io G Io) for at least 
\U\/2n° B -*W = 2 n /n° B ^ sets U. 

Because |/o| = 0B )£ (1), there is a way to partition Io into Iq U Iq such that there are 
2«y n o s , e (i) se ^ s amon g [/ above that satisfy ?7 n/o = Iq- Let W^j" denote the collection 
of these U. 

By passing to consider a subset of Up if needed, we may assume that either i £ U or 
i £ U for all £7 G Up i%- Without loss of generality, we assume the first case. (The other 
case can be treated similarly). 

Let U G and u = (u\, . . . , u n ) be its characteristic vector (uj = 1 if j G U, and Uj = 

otherwise) . 

By the definition of Ajj, and because I' nU = and Iq C [7, for any i' G Iq and i ' G Iq 
we can write 



a-i^u) -y = Yl "'',/"/•'//• and a i;; (^) ■ y = ^ a o(! - 

3=1 3=1 

Also, because i U, we have 



3=1 



Thus, 
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kai(Au) ■ y + ^^(Au) • y 



kai(Au) ■ y + Y fc^a^OM • y + ^ fc^/a^^c/) • y 



*O tJ 



3=1 i=Ke'o i=iM 



3=1 ije/fi iffeJtf i=ii&'e/£f 



Next, by Lemma 14. 1|, the following holds for each J7 € Uv 1^ 



P y (||fcai(^)-y+ £ fen a i0 (A C7 )-y||2 = O(/3n°^ 1 ))l = n -°°- a) 



Also, recall that 



\U Vo ^\ = 2 n /n ^ l \ 



Hence, 



EyEu^WkmiAu) -y+Y k ao*i (Au) ■ y||a = 0(/3n° B - E(1) )J > n" *-'* 1 *. 



By applying the Cauchy-Schwarz inequality, we obtain 



n 



-Ob, £ (1) < 



EyEc/dl^^c/) • y + hi *i (Au) ■ Yh = 0((3n° B -^)) 



Eu(\\kai(Au) -y+Y k no^ (Au) ■ yh = 0{pn°»*V>)) 



ioelo 



E u(|| Y( kcLi i + k ii' a i' 3 ~ Y k n'i a i'ii) u iyi + Y Y ty^M H 2 = 0(/3n° B ' e(1) )) 



< E y E UiU /M| J^fcyOtf + kw'^j - J] k ii'J a i'Jj)( u j ~ u j)Vjh = 0{l3n° B -<- 



j"pT" 
l fcJ 



E z(|| ^(fcaij + Y k ii' a i' j ~ Y tyai^Zjh = 0(/3n° B -* 



-%3 

3=1 i' el' igeiS 



(14) 
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where Zj := (iij — u'j)yj, and in the last inequality we used the fact that 



Eu,u'0l/(u)|| 2 = 0(f3n ^), \\f(u')\\ 2 = 0(/3n ^)) < E u , u , (||/(u)-/(u')|| 2 = O^n ^ 1 



Note that Uj — u'j are iid copies of the Bernoulli random variable 27/ 1 / 2 ) . Hence Zj are iid 
copies 

of 2r/ 1 /2)(£_£/) ) where rf 1 ™ is independent of £ and 
In conclusion, the following holds for any i 6 I, 



Pz(|| X><%' + ^ fc^o^- - tyaqjteh = 0(f3n°^)) > 



Note that A; and Jo are independent of the choice of i. By changing the sign of k^, we are 
done with the proof of Theorem 11.81 



p 

1 v,w 



Appendix A. Proof of Lemma 13.11 
The goal of this section is to establish the inequality 

A u(ij)viW jh = B {P^/\^)) > ip 8 /((2^) 7d/2 exp(8vr)), 
under the assumption 

PxM| ^aijXiXj + ^2 l b i x i - a\ < (3) = p > n~ B . 

i,j i 

Set a'ij := c%-//3. We have 

supP x ( || a'^XiXj + y^b'iXi - a'\\ 2 < 1) > rT B . 

n' b' ^ ' 

Next, by Markov's inequality 



sup 

a,bi,...,b n 



Px (ll ^2 a 'ij x i x j + '^2 b 'i x i ~ a 'h < l) = P ( exp(- ^ 1| ^ a'jjXjXj + s ^a' i x i - a'\\ 2 2 > exp(-^) 

i,j i i,j i 

< exp(^)E x exp ( - ~|| ^ a'^XiXj + ^fr-x; - a'HlJ. 
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Note that 



ex P(-|lMl2) = J e(x-t)exp(~\\t\\l)dt. 



Thus 



P x(ll Yl a ij XiX i + Yl b i Xi ~ a '\\ 2 - X ) - eX P(f ) J d E ^4(Yl a ij XiX 3 + Yl b i Xi y^ eX P(~f ll*H 2 ) d * 

i,j i Rd i,j i 

< exp(|)(v / 2^) d ^ \^e[(£a' ijXiXj + J>^)) ■ t]\ exp(-|||t|||)/(v^r) d cft. 

Consider x as (xjj,Xjy), where xjj,Xjj are the vectors corresponding to i G U and i ^ U 
respectively. By the Cauchy-Schwarz inequality we have 



< 



< 



E x e(£>^x, • t)| exp(-5||t||l)/(v^F) d dt' 

i |E x e((^a^.x^ + ■ t)| 2 exp(-|||t|||)/(v^)^ 

E Xu |E x ^((^a^x J + ^6^)-t)|%xp(-|||t||2)/(v^) d dt 



R 



R rf 



= [ / E X[7 E X _ ;X ,_ e(( J] a^x^xj - xj) + ftj-fo - x'j) 

+ <j( x i x j- x Wj))-t)eM-l\\M\l)/(^) d dt] 2 
ieu,jeu 

< / d E Xc7 , x '_ |E X[7 e(( a^ifo - x'j) + ftj-fo - x)) 

Rd ieu,jeu jeu 

+ £ a^x^-x^-)) ■t)| 2 exp(-|||*||i)/(v^F) <i d4 

= / E x ^ x _ y _e(( J] ^-(Xi - a^)^- - ^)) ■ *) expC-llltHD/Cv^F)' 

d i€U,j£U 

= f Rd E yu,*u e {( E 4^)t)exp(-^||t||2)/( v / 2^)^, 



ieujeu 

where y;y = X[/ — and zq- = xp — x'^., whose entries are iid copies of £ — 
Thus we have 
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|E xe ((^a^^)-t)|(exp(-|||t||l)/(^)^ 



2 

hi 



Ey„z,e(( £ a^ yi z 3 )-t){zM-l\nl)K^) d dt 
ieu,jeu 

<^E y[ , )Z _ iy ^_e(( <jVi z 3- E «^^)-i)exp(-|||ti)/(^) d dt. 



i£U,jeU ieU,j£U 



Because a'„- = a'-,-, we can write the last term as 



j E yu j_y ut , e({ E 4^ + E °i<(-4)»i)-*) ex P(-fll*ll2)/(v^) d * 

Rd i£U,j£U jdU,idU 

= ^E ViW e(( ]T a^^+ £ a^^)-t)exp(-|||t||2)/(V2^)^, 



ieujeu ieu,jeu 



where v := (y^, -z'^) and w := (y'^, z ). 

Next, reacall that Au(ij) = aij if either i £ U,j U or i ^ U, j € [7, we have 



fv(( E + E 4^)*) ex p(-f iwiDa^o 

= (l/v^) d E v , w exp(-|||^^(ii)'^||^), 



where Au(ij)' := Ajj{ij) / (3. 
Thus 



/ = (Px(| E 4 X *> x i + E h 'i Xi ~ a 'i - *)) 

< exp(4vr)(2vr) 4d ( ^ |E x e((£ a^x,-) • t)|(exp(-|||t||2)/(^)^) f 



< exp(47r)(27r) w / 2 E ViW exp(-||| ^(ij)'^^^) 



Because p > n B , the inequality above implies that 
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V v ^{\\Y,A u {ij)'v i w J \\ 2 = B {^^)) > ip 8 /((2^) 7d/2 exp(47r)). 

S3 

Scaling back to Aij, we obtain 

P ViW (||^A c/ (y>i^|| 2 = B (Py/togri)) > ip 8 /((2^) 7d/2 e X p(4vr)), 
completing the proof. 
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